Kog Inference Engine

Kog released Laneformer 2B, a 2.3B-parameter coding model designed for high-speed decoding, on Hugging Face Hub. The model was trained from scratch with latency as the primary objective, achieving 45.…

Kog AI achieved over 3,000 output tokens per second per request for an FP16 2B model on a single 8× MI300X node using a monokernel that eliminates per-token kernel launches. The technique collapses th…

Kog AI launched a tech preview of its Kog Inference Engine (KIE), achieving 3,000 output tokens per second per request on 8× AMD MI300X GPUs and 2,100 on 8× NVIDIA H200 GPUs using a 2B model. The comp…